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language 

from Latin ‘^‘^lingua” (tongue) 

- a system for the expression of thoughts, feelings, etc, by 
the use of spoken sounds or conventional symbols 







Desiderata 


Syntax looks like pseudocode 
Vocabulary to talk about data & operations 
Large standard library 
Qood performance 



julfa 

High-leuel 

Dynamic type system 

Performance approaching statically-compiled 

languages 

Metaprogramming 

Parallelism 

Qood interop with other languages 
MIT licensed 
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BacRground 



Technical Computing Landscape 







Matlab 

Python 

Julia 

Introduced 

1984 

1991* 

2012 

Creators 

MathWorks 

Quido uan 
Rossum 

Jeff Bezanson, Stefan 
Karpinsbi, Viral Shah, 
Alan Edelman 

License 

Proprietary 

BSD-style 

MIT 

Name 

"Matrix 

Laboratory” 

Monty Python 

7 

• 


*NumPy introduced in 1995 as Numeric and 2006 as NumPy 







Syntax 



Mandelbrot 


function mandelCz) 
c = z 

maxiter = 80 
for n = limaxiter 
if absCz) > 2 
return n-1 
end 

z = z^2 + c 
end 

return maxiter 



end 


randmatstat 

function randiTiatstat(t) 
n = 5 

V = zeros(t) 
w = zeros(t) 
for i = l:t 

a = randn(n,n) 
b = randn(n,n) 
c = randn(n,n) 
d = randn(n,n) 

P = [abed] 

Q = [a b; c d] 
v[i] = trace((P'*P)M) 
w[i] = traceCCQ'*Q)M) 
end 

std(v)/iTiean(v), std(w)/iTiean(w) 


end 


Fibonacci 


fibCn) = n < 2 ? n : fibCn-1) 


+ fibCn-2) 


fibC20) # => 6765 


Data Structures 


Vectors 

Matrices 

Strings 

Tuples 

Dictionaries 

Sets 




b = [4, 5, 6] 
b[l] # => 4 
b[end] # => 6 


matrix = [12; 34] 

tup = (1, 2, 3) 
tup[l] # => 1 
tup[l] = 3 # => ERROR 

diet = ["one"=> 1, "two"=> 2, "three"=> 3] 
dict["one"] # => 1 

filled.set = SetCl,2,2,3,4) # => Set{Int64}Cl,2,3,4) 


Exception Handling 


try 

errorC'help") 
catch e 

printlnC'caught it $e") 
end 

# => caught it ErrorExceptionC'help") 


Strings 

splitC'wow look at these words") 

# => 5-element Array{SubString{ASCIIString},l}: 
"wow" 

"look" 

"at" 

"these" 

"words" 

joinCC'We invited the rhinoceri", "Washington", 
"and Lincoln"], ", ") 

# => "We invited the rhinoceri, Washington, and 
Lincoln" 


Regexes 

ismatchCr"^\s*Ci^ IS)" ) ci comment") 

# => true 

m = matchCr"Ca Ib)Cc)?Cd)" , "acd") 

# => RegexMatchC^acd", l="a", 2="c", 3="d") 

m.captures 

# => 3-element 

Array{UnionCSubString{UTF8String},Nothing),1} 


Comprehensions 

[i + j for i = 1:3, j = 1:5] 

# => 3x5 Array{Int64,2}: 

2 3 4 5 6 

3 4 5 6 7 

4 5 6 7 8 

[i => charC64 + i) for i = 1:5] 

# => [5=>'E',4=>'D',2=>'B',3=>'C',1=>'A'] 


FP-style shenanigans 

mapCx -> X * 2, [1, 2, 3]) 

# => [2,4,6] 

reduceC*, 1, [1, 2, 3]) 

# => 6 

mapCs -> (s, lengthCs)), subsetsCEl, 2, 3])) 
# => [C[],0),C[1],1),C[2],1),C[1,2],2),C[3], 
1),C[1,3],2),C[2,3],2),C[1,2,3],3)] 


Matrix Operations 


trace 

det 

eigfact 

sparse 

inv 

kron 



Shell Commands 


a=readallC'echo hello') 

# => "helloXn" 

file = "/etc/passwd" 

# => "/etc/passwd" 

'sort $file' 

# => 'sort /etc/passwd' 

runC'echo world' & 'echo hello' l> 'sort') 

# => hello 
world 


Coroutines 


function producerC) 
produceC'start") 
for n=l:4 

produceCZn) 

end 

produceC'stop") 


for X in TaskCproducer) 
printlnCx) 
end 

# => start 
2 
4 
6 
8 

stop 


end 


Type System 



Julia's Type System 

Dynamic 

• No "compile-time type” 

• Only ualues, not uariables, haue types 
Nominatiue 

• Relationships betiueen types explicitly 
declared 

• Concrete types are final 
Parametric 

• Abstract and concrete types can be 
parameterized by other types & certain ualues 



Multiple Dispatch 

All functions in Julia are generic 

• First-class objects 

• Can be passed around 

• Can be extended 

Function definition that is called depends 
the types of all its argument 



Multiple Dispatch Demo 

Notebook from Stefan Karpinskies talk at 
Strange Loop 2013 



Ill 

III 









Traditional Language Split 

• Prototype in high-leuel language 

• Write performance critical code in a loui-leuel 
language e.g. C or Fortran 

• Tie together u^ith 

• Mex 

• Ctypes 

• Cython 

• SWIQ 




eating our cake too? 




s 


t 





S 


I 


I 




o 


o 


benchmark 

O rand_mat_mul 

• rand_mat_stat 

• pi_sum 
o printfd 
o mandel 

• quicksort 

• fib 

• parse_int 



Julia Fortran 


Go JavaScript Python Mathematica R 


Matlab Octave 


Figure: benchmark times relative to C (smaller is better, C performance = i.o). 


JIT 

Julia compiles the code it needs at run-time 

• jIT = "just in time" 

• Translates each method into machine code 
Utilizes LLVM for optimization and code 
generation. 



LLVM 



• Originally "Lolu leuel uirtual machine" noiu 
LLVM is the full name of the project 

• Collection of modular compiler and toolchain 
technologies 

• Introduced by Vihram Adue and Chris Lattner 
at Uniuersity of Illinois in 2003 

• Used by Apple as part of deu tools for Mac OS 
X and iOS 


Traditional Approaches 


Source 

Code 


Frontend 


Optimizer 


Backend 


Machine 

Code 


Three-phase compiler 



Effect 


Bytecode Interpreter 









LLVM Design 


c -► 

C Fronlend 

\ / 

X86 Backend 



\ / 


Fortran -► 

Fortran Fronlend 

M Common 

^ Optimizer 


PowerPC Backend 



/ \ 


Ada 

Ada Frontend 

/ \ 

ARM Backend 


X86 


PowerPC 


ARM 


LLVM uses a common code representation 





















LLVM IR 


• IR = intermediate representation 

unsigned addlCunsigned a, unsigned b) 

return a+b; 

} 

define i32 @addlCi32 %a, i32 %b) { 
entry: 

%tmpl = add i32 %a, %b 
ret i32 %tmpl 


} 


Julia's JIT Pipeline 









Types Help to Qenerate 

Efficient Code 

LLVM and types demo 



Side benefit 

Since Julia is fast, most of Julia is luritten in 
itself 

• You can learn by poking around source of 
Julia and its standard library 

• Easy to contribute core components 



other JITted systems 

PyPy 

• Tracing JIT (us method-at-a-time JIT) 

• No support for Numpy 
Numba 

• NumPy compatible, based on LLVM 

• Uses NumPy type information for inference 

• Doesn't remoue dynamic indirection for less luell- 
typed ordinary Python code 

Pyston 

• Announced earlier this month by Dropbox 

• Still in early phases, far from release 



Metaprogramming 



Homoiconidty 

Code liues in data structures that can be 
manipulated by the language itself. 

In Julia's case, Expr and Symbol types. 



type Expr 
head::Symbol 
args::Array{Any,l} 
typ 

end 

ex = :Cci+b*c+l) 

# => :C+Ca,*Cb,c),l)) 

typeofCex) 

# => Expr 

ex.head 

# => :call 


ex.args 

# => [:+,:a,:C*Cb,c)),l] 


Macros 

• Special functions to directly manipulate 
expressions 

macro assert(ex) 

:C$ex ? nothing : error("Assertion failed: ", $(string(ex)))) 
end 

@assert 1==1.0 

# => 


@assert 1 == 0 

ERROR: assertion failed: 1 == 0 
in error at error.jl:21 




©parallel 


# parfor.jl 
@time begin 

nheads = @parallel (+) for 1=1:2000000000 
intCrandboolO) 
end 
end 

$ julia parfor.jl 

elapsed time: 10.333040655 seconds (6323888 bytes 
allocated) 

$ julia -p 8 parfor.jl 

elapsed time: 2.505858567 seconds (13534036 bytes 
allocated) 


pmap 


# pmap.jl- 

M = {rand (1000,1000) for 1=1:10} 

@time pmapCsvd, M) 

$ julia pmap.jl 

elapsed time: 7.620465569 seconds (575974660 bytes 
allocated) 

$ julia -p 8 pmap.jl 

elapsed time: 4.206753903 seconds (524003124 bytes 
allocated) 


Cluster Computing 

Worl^ers don't haue to be on the local machine 

• Passiuordless SSH 

• ClusterManagers.jl : Sun Qrid Engine, ... 

• AWS.jl : interface to Amazon Web Seruices 
(EC2, S3) 



And more 


Distributed arrays for splitting large matrices 
across uiorbers 

Primitiues for pushing data bach and forth 
@sync, @async 



Interop 



Calling C 

function getenv(var: :String) 
val = ccall( (rgetenv, "libc"), 

Ptr{Uint8}, (Ptr{Uint8},)> bytestring(var)) 
if val == C_NULL 

errorC'getenv: undefined variable: ", var) 
end 

bytestring(val) 

end 


getenvC'SHELL") 

# => "/bin/bash" 


Calling Python 

PyCalLjl offers automatic conuersion of types 
betu^een Julia and Python 

• numeric, boolean, string, functions 

• tuples, arrays, and dictionaries of aboue 
Julia arrays are conuerted to NumPy arrays 
uiithout making a copy 

Demo 



Calling MATLAB 

using MATLAB 

function thinboundaryCbmap: iBitMatrix) 

@mput bmap 

@matlab bmapthin = bwmorphCbmap, "thin", inf) 
convertCBitArray , @mget bmapthin) 


end 


Calling C++ 

• More difficult 

• Usually easiest to create thin C-language 
uirapper around the code you ujant to call 

• C pp.jl handles ABI name-mangling, but C++ 
objects cannot be conuerted 

int timestwoCint x) { 
return 2*x; 

} 

X = 3.5 

x2 = @cpp ccallCC:timestwo, libdemo), Float64, 
CFloat64,), x) 



Calling Julia 

From C/C++ 

• Use Julia's C API 
From MATLAB 

• julia-matlab package 

• Can u^rite performance critical code in Julia 
ujithout resorting to MEX 

From Python 

• p yjulia : still experimental at this point 



Interactiuity 



Enuironments 


REPL 

lJuUa notebooh 

• http://nbutgiugr.Lpython.org to sharg 
notgboohs 

Forto Julia Studio 

• Visual IDE 




Seueral options 

• Qodfly.jl 

• similar to ggplot2 

• influenced by Leland Wilkinson's "Qrammar 
of Qraphics” 

• Winston.jl 

• similar to Matplotlib, still light on features 

• Qaston.jl 

• interface to gnuplot 
No clear luinner yet 



PyPLot.jL 

• Wrapper around Matplotlib's API 


using PyPlot 
X = linspaceC-2pi , 2pi) 
y = sinCx) 
plotCx, y, "-b") 


_1 qI--- ---- 

-8 -6 -4 -2 0 2 4 6 8 








Community 



Adoption 

Already used in courses at: 

• Stanford 

• Penn State 

• Cornell 

• MIT 

• Western 




Community 


• Small but actiue, helpful, groiuing 

• Strong open-source culture 

• Design discussions take place in the 
julialang repo on Qithub 


2,000 

1,500 

1,000 

500 



■ Total 
Posts 


b-S'l ' 

julia-users, posts from June 2013 - present 


0 





Package Manager 

git based, integrated with Qithub 
Installing a pachage 

Pkg.addC" Images") 

Creating a pachage for local deuelopment 

Pkg.generateC'FooBar" , "MIT") 

When you're ready to publish to Qithub 

Pkg. registerC'FooBar") 

To make your package uisible to euerybody, 
submit a pull request to the METADATA repo 


Packages 



Lots of useful packages 

• Images.jl 

• Qraphs.jl 

• DatQFrames.jL 

• DimensionaLityReduction.jL 

• Distributions.jl 

• NLOpt.jl 

• Arg Parse.) L 

• Lo g gin g .jl 

• Facte heck.jl 

• Many more - check out https://github.com/JuLiaLang/ 
METADATA.)L for the full list 





QPU Computing 

At this point: mostly loiu-lcucl API lurappcrs 

• CUDA.il 

• CUDArt.jL 

• OpenCLjl 



More on the luay 

Qoogle Summer of Code 2014 projects 

• Julia ujrappers for high performance QPU 
programming 

• Computer uision using OpenCV 

• Julia frontend for Halide, an image 
processing language 


u Assessment 



Desiderata 

’ Syntax lool^s lihe pseudocode 
’ Vocabulary to talk about data & operations 
’ Large standard library 
• Qood performance 



Reasons to choose Julia 

• Fast prototyping ujithout sacrificing speed 
’ Easy to parallelize code 

• Types make expressing algorithms simpler 

• Plays u^ell u^ith other languages 

• Standard library u^ritten in Julia 

• Friendly and helpful community 




Reasons not to choose Julia 

• You are primarily a NN researcher (not just a 
user) 

• QPU infrastructure not quite in place 

• You need to lurite production code 

• Language is still groiuing, interfaces may 
change 

• You luant to lurite the next NLTK or other luidely 
used package 

• May luant to go luith a more popular language 



Resources 



Hoiu to Try 

• Try Julia online at http://forio.com/julia/rcpl/ 

• To install: 

git clone https://github.com/JuliaLang/julia 
cd julia 

make (or make - j N, luhere N is your desired number of 
parallel processes) 

# In -s $PWD/julia /usr/bin/julia 



Resources 


Julia Manual 
Julia Standard Library 
Learn Julia in Y minutes 
User groups 

• Julia-users 

• julia-deu 

• julia-stats 
Talks 

• Julia Tutorial at MIT. Jan 2013 

• Stefan Karpinski @ Code Mesh 2013 
Read the source. Luke! 


Helpful Cormmands 

?map 

• display documentation for the map function 

aproposC“reduce”) 

• show all functions with the term "reduce" in 

their documentation 

methods(+) 

• display all instantiations of generic + function 

methodswith(Biglnt) 

• display all functions inuoluing Bigints 




